AD-A168  212 


ARI  Research  Note  86-14 


TRAINING  EXTENSION  COURSE  COST  AND  TRAINING 
EFFECTIVENESS  ANALYSIS  METHODOLOGY 


Peter  G.  Sassone,  James  Bercos 
Mellonics  Systems  Development  Division 
Litton  Systems,  Inc. 


and 


John  E.  Holmgren 
ARI  Fort  Benning  Field  Unit 


for 


ARI  Field  Unit  at  Fort  Benning,  Georgia 


TRAINING  RESEARCH  LABORATORY 
Seward  Smith,  Acting  Director 


U.  S.  Army 

Research  Institute  for  the  Behavioral  and  Social  Sciences 


January  1986 

866  2050 

Approved  for  public  release:  distribution  unlimited. 


U.  s.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

A  Field  Operating  Agency  under  the  Jurisdiction  of  the 
Deputy  Chief  of  Staff  for  Personnel 


EDGAR  M.  JOHNSON 
Technical  Director 


WM.  DARRYL  HENDERSON 

COL,  IN 

Conunanding 


Thit  rapon,  at  tubmitiad  by  tha  contractor,  hat  baan  claarad  for  ralaate  to  Dafanta  Tachnical  Information  Center 
(DTIC)  to  comply  writh  regulatory  raquiremantt.  It  hat  been  glean  rto  primary  dittribution  other  than  to  OTIC 
and  will  ba  available  only  through  DTIC  or  other  rafaranca  tarvicat  luch  at  the  National  Technical  Information 
Service  (NTISI.  The  viewt.  epinient,  artd/or  findirtgt  contairtad  in  thh  report  arc  thotc  of  tha  authorfti  and 
thould  not  ba  conttruad  at  an  official  Dapartment  of  tha  Army  potition,  policy,  or  dacition,  unlett  to  detignated 
by  other  official  docuiTMntation. 


m 


m 

m 

m 


L 

•m 

Wi 


m 

i 


%»'I 

¥ 

Wa 


'cl*] 


255 


SECURITY  CLASSIFICATION  OF  THIS  PACE  (RKwl  Data  EnlaraO) 


REPORT  DOCUMENTATION  PAGE 


I.  REPORT  NUMBER 

ARI  Research  Note  86-14 


4.  TITLE  (and  Sublllla) 

TRAINING  EXTENSION  COURSE  COST  AND  TRAINING 
EFFECTIVENESS  ANALYSIS  METHODOLOGY 


AUTHORfA) 


READ  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 


3.  RECIPIENT'S  CATALOG  NUMBER 


S.  TYPE  OF  REPORT  4  PERIOD  COVERED 

Interim  Report 
Dec.  1976  -  Aug.  1979 


S.  PERFORMING  ORC.  REPORT  NUMBER 


B.  CONTRACT  OR  GRANT  NUMBERfa; 


Peter  G.  Sassone,  James  Bercos, 
and  John  E.  Holmgren 


S.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Mellonlcs  Systems  Development  Division 
Litton  Systems,  Inc.,  P.O.  Box  2498 
Fort  Benning,  Georgia  31905 


11.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

ARI  Field  Unit  at  Fort  Benning,  Georgia 
P.O.  Box  2086, 

Fort  Benning,  GA  31905 


14.  MONITORING  AGENCY  NAME  4  ADORESSfl/  dlllatani  tnm  CanUatUng  Olllea} 

U.S.  Army  Research  Institute  for  the  Behavioral 
and  Social  Sciences,  5001  Elsenhower  Avenue, 
Alexandria,  VA  22333-5600 


IS.  DISTRIBUTION  STATEMENT  (al  thia  Rapart) 

Approved  for  public  release;  distribution  unlimited. 


17.  DISTRIBUTION  STATEMENT  (at  Ota  abalrael  antarad  In  Btaek  30,  It  dtUarant  tram  Rapart) 


DAHC  19-77-C-OOll 


10.  PROGRAM  ELEMENT,  project.  TASK 
AREA  4  WORK  UNIT  NUMBERS 


2Q763731A770 


IZ.  REPORT  DATE 

January  1986 


IS.  NUMBER  DF  PAGES 

59 


IS.  SECURITY  CLASS,  (at  Oila  rapart) 


Unclassified 


ISa.  DECLASSIFICATION/DOWNGRADING 
SCHEDULE 


IS.  supplementary  NOTES 


Seward  Smith,  contracting  officer's  representative. 


IS.  KEY  WORDS  (Caatinua  an  rararaa  alda  It  naeaaaarr  and  tdantitp  bp  black  ntaibar) 

Training  Extension  Course  (TEC)  ^TEC  Lessons.. 

Training  Extension  Material  TEC  Manager 

Training  Effectiveness  Analysis  TEC  Validation*  , 
Training  Methodology 


20.  ABSTNACT  (Canttaua  an.  ravaraa  alda  ft  ttaaaaaarr  aad  Idantllr  by  black  mmibar) 

r^This  report  addresses  the  development  of  a  methodology  for  Training  Exten¬ 
sion  Course  (TEC)  Cost  Training  Effectiveness  Analysis  (CTEA),  where  effective¬ 
ness  is  a  function  of  unit  performance  as  measured  by  the  Army  Training  and 
Evaluation  Program  (ARTEP) .  This  report  deals  specifically  with  the  theoretical 
development  of  the  methodology.  K  ''  '  - 


DD  .'rW  1473 


EDITION  OF  I  NOV  SS  14  OBSOLETE 


UNCLASSIFIED 

SECURITY  CLASSIFICATION  OF  THIS  PACE  (Whan  Data  enlmtad) 


T 


P 


I  FOREWORD 


This  task  report  is  one  of  several  provided  by  the  Mellonics 
Systems  Development  Division  of  Litton  Systems,  Inc.,  to  the  Army 
Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI) 
under  Contract  Number  DAHC  19-77-C-OOll. 

Under  the  contract,  a  part  of  the  Mellonics  effort  concerns 
support  to  the  ARI  evaluation  of  the  utilization,  acceptance,  costs 
and  effectiveness  of  the  Army  Training  Extension  Course  (TEC)  Program. 
Related  earlier  reports  focused  on  the  cost  and  training  effectiveness 
of  TEC  where  effectiveness  was  a  function  of  individual  performances 
on  selected  hands-on  performance  tests,  and  the  relation  of  TEC  usage 
to  individuals  performances  on  their  SQT.  Results  showed  TEC  effective 
in  training  individuals  and  a  positive  relationship  between  TEC  usage 
and  SQT  scores. 

The  first  TEC  report^  in  this  current  series  documents  the  con¬ 
duct  and  findings  of  a  training,  cost  and  effectiveness  literature 
search  and  review  of  selected  literature.  It  serves  as  the  intro¬ 
duction  to  other  reports  in  this  series .  The  second  report^  provides 
guidance  for  the  collection  of  individual  and  unit  training  data 
necessary  to  support  the  TEC  Cost  Training  Effectiveness  Analysis 
(CTEA)  Methodology.  This  report  addresses  the  development  of  a  TEC 
CTEA  Methodology,  where  effectiveness  is  a  function  of  unit  perfor¬ 
mance  as  measured  by  the  Army  Training  and  Evaluation  Program  (ARTEP) 
evaluation.  This  report  is  the  theoretical  development  of  the  Method¬ 
ology.  A  planned  subsequent  report  will  deal  with  the  practical 
application  of  the  Methodology. 


^Sassone,  P.  G.  Literature  Review  -  Cost  and  Training  Effectiveness. 
Litton-Mellonics,  Training  Extension  Course  Research  Task  Report: 

July  1978. 

^Bercos,  J.  Extension  of  Trainrng  Extension  Course  Cost  and  Training 
Effectiveness  Analysis  Data  Collection.  Litton-Mellonics,  Training 
Extension  Course  Research  Task  Report:  June  1979. 


TRAINING  EXTENSION  COURSE  COST  AND  TRAINING  EFFECTIVENESS  ANALYSIS 
METHODOLOGY 


BRIEF 


Requirement : 

To  develop  a  Cost  and  Training  Effectiveness  Analysis  (CTEA) 
Methodology  that  will  identify  the  contributions  of  Training  Exten¬ 
sion  Course  (TEC)  training  to  a  unit  performance  as  measured  by  the 
Army  Training  and  Evaluation  Program. 


Procedure  and  Findings: 

The  development  of  the  Methodology  required  four  areas  of  speci¬ 
fication,  First,  a  measure  of  unit  effectiveness  was  assumed  to  be 
derivable  from  the  pass/fail  (satisfactory/unsatisfactory)  scoring 
criteria  currently  in  use.  Secondly,  the  assumption  was  made  that 
costs  of  field,  garrison,  and  TEC  training  can  be  determined.  Thirdly 
the  resource  allocation  model  was  developed  from  which  can  be  inferred 
the  economic  value  of  TEC,  The  effectiveness  production  function 
assumes  soma  specifiable  relationship  between  inputs  and  outputs  of 
the  training  process  which  operates  under  specific  budget  constraints. 
Lastly,  the  use  of  the  valuation  methodology  in  a  present  value 
analysis  to  derive  an  ultimate  dollar  value  of  TEC  was  outlined. 


Utilization: 

This  report  describes  a  CTEA  Methodology  which  integrates  implicit 
knowledge  of  the  training  process  and  training  budget  constraints  to 
evaluate  the  effectiveness  of  TEC  training.  The  unit  is  the  object 
of  the  analysis  which  is  evaluated  by  means  of  ARTEP  procedures . 

Since  TEC  usage  can  change  both  effectiveness  and  costs,  the  valua¬ 
tion  methodology  was  developed  from  a  cost-benefit  point  of  view. 
However,  this  valuation  methodology  can  be  applied  to  any  training 
program  which  serves  a  complementary,  rather  than  as  a  substitute, 
training  program. 
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TRAINING  EXTENSION  COURSE  (TEC)  COST  AMD  TRAINING  EFFECTIVENESS 
ANALYSIS  (CTEA)  METHODOLOGY 


INTRODUCTION 


THE  TRAINING  EXTENSION  COURSE  (TEC)  PROGRAM 

TEC  is  a  program  that  has  been  designed  to  put  into  the  hands 
of  trainers,  both  in  units  and  in  institutions,  high  quality  per¬ 
formance-oriented  multimedia  training  packages.  It  is  designed  to 
provide  soldiers  with  immediate  access  to  self-paced  instruction 
especially  designed  to  assist  them  in  acquiring  and  maintaining 
skills  critical  to  their  performance  in  combat.  TEC  lessons  are 
designed  for  use  on  an  individual  basis;  however,  they  may  be  used 
by  small  groups,  under  the  supervision  of  an  NCO. 

TEC  P.ELATED  RESEARCH 

The  advent  of  the  TEC  program  inaugurated  a  multi-faceted  TEC 
research  effort  conducted  under  the  sponsorship  of  the  U.  S.  Army 
Training  Support  Center  (USATSC)  by  the  U.  S.  Amy  Research  Insti¬ 
tute  for  the  Behavioral  and  Social  Sciences  (ARI)  and  the  Mellonics 
Systems  Development  Division  of  Litton  Systems,  Inc.  The  research 
comprises  investigations  concerning  current  and  projected  usage  of 
TEC  in  the  Active  and  Reserve  Components,  training  effectiveness  and 
retention  of  TEC  instruction,  current  and  projected  costs  of  the  TEC 
program,  cost-effectiveness  of  TEC,  and  the  development  of  a  TEC 
Manager's  Guidebook. 

o  The  effectiveness  and  retention^  investigation  evaluated 
TEC  lessons  relative  to  conventional  instruction  in  the 
Active  and  Reserve  Components.  The  experiments  included 
five  subject  areas,  one  common  to  all  combat  arms  soldiers 
and  four  specific  to  each  of  the  four  combat  arms.  The 
investigation  determined  that,  averaged  across  the  five 
subject  areas,  the  TEC  trained  soldiers  performed  better 
than  the  conventionally  trained  soldiers  on  both  the  ini¬ 
tial  and  retention  (8  to  9  weeks  after  the  initial)  hands- 
on  performance  tests. 


^Holmgren,  J.  E.,  Hilligoss,  R.  E.,  Swezey,  R.  V;. ,  and  Eakins,  R.  C. 
The  Training  Effectiveness  and  Retention  of  TEC  Instruction  in  the 
Combat  Arms.  U.  S.  Army  Research  Institute  for  the  Behavioral  and 


o  An  effectiveness  and  retention  related  investigation^ 
concerned  the  relationship  of  performance  on  the  Skill 
Qualification  Test  (SQT)  ard  the  amount  of  TEC  use. 

The  investigation  was  based  on  TEC  usage  data  (TEC 
usage  investigation  above)  and  SQT  data  obtained  from 
USATSC  for  the  same  personnel  (3  Armor  and  3  Infantry 
battalions)  to  whom  the  usage  data  applied.  Correla¬ 
tion  analyses  showed  a  consistent  positive  relationship 
between  the  use  of  TEC  lessons  and  performances  on  the 
relevant  SQT. 

o  The  investigation  of  TEC  program  costs^  produced  cost 
information  for  use  in  a  TEC  cost  and  Training  Effec¬ 
tiveness  Analysis  (CTEA) .  The  information  was  developed 
in  terms  of  sunk  costs  (monies  expended  or  obligated  in 
the  period  prior  to  FY  1978)  and  future  costs  (estimates 
of  annual  costs  to  be  incurred  in  continuing  a  given  TEC 
program  during  the  period  FY  1978  through  FY  1987)  .  Both 
costs,  sunk  and  future,  include  contract  costs  and  other 
government  costs.  From  the  sunk  costs  and  other  informa¬ 
tion,  estimates  were  developed  for  the  cost  of  TEC  to  a 
battalion . 

o  An  adjunct  TEC  cost  investigation^  concerned  cost  savings 
or  cost  avoidance  to  the  U.  S.  Army  resulting  from  the 
use  of  already  available  TEC  materials  to  replace  or 
supplement  conventional  instruction  at  the  TRADOC  Branch 
Schools.  Data  for  FY  1977  collected  from  the  TRADOC 
schools  showed  real  and  potential  annual  cost  savings 
from  the  direct  use  of  TEC  materials  in  instructional 
training  and  cost  avoidance  (no  need  to  develop  materials) 
from  TEC  substitution  for  conventional  instruction  in  new 
or  self-paced  training. 


'^Strasel,  H.  C.,  Holmgren,  J.  E.,  Bercos,  J. ,  Shafer,  J.  C.,  and 
Eakins,  R.  C.  Training  Extension  Courses  (TEC) :  Cost  and  Training 
Effectiveness .  U.  S.  Army  Research  Institute  for  the  Behavioral  and 
Social  Sciences,  Research  Report  Draft,  November  1977. 


o  A  second  adjunct  cost  investigation  concerned  the  quan¬ 
tification  (and  expression  in  dollars)  of  TEC  benefits. 

The  benefits  were  estimated  as  potential  savings  of 
training  resources  (time  and  aimmunition)  resulting  from 
TEC  trained  individuals'  better  performance  on  selected 
tasks  than  conventionally  trained  individuals  for  a 
period  of  combat/intensive  training.  The  investigation 
showed  the  potential  is  real  to  achieve  a  given  level 
of  soldier  proficiency  with  a  reduced  period  of  combat/ 
intensive  training  or  to  exceed  the  given  level  of 
soldier  proficiency  in  the  normal  period. 

o  The  cost-effectiveness  analyses^  integrated  the  data  and 
results  from  the  above  outlined  research,  and  also  used 
the  data  and  results  to  assess  the  relative  worth  of  TEC. 

For  the  relative  worth  analysis,  an  estimated  cost  of  a 
TEC  impression  (a  single  use  of  a  TEC  lesson  by  one  indi¬ 
vidual)  was  developed,  as  was  a  model  to  estimate  indi¬ 
vidual  soldier  proficiency  in  relation  to  training  on 
specific  tasks  conventionally  and  with  TEC,  The  relative 
worth  analysis  indicated  that,  at  the  current  usage  level, 
TEC  training  is  equivalently  cost-effective  as  conventional 
training,  and  that  at  higher  usage  levels,  TEC  can  be  more 
cost  effective. 

The  research  outlined  above  mainly  addressed  the  cost  and  training 
effectiveness  of  TEC  instruction  relative  to  the  individual  combat 
arms  soldier.  Obviously,  the  same  or  extended  analyses  are  needed  for 
units.  In  this  connection,  the  USATSC  has  defined  a  requirement  for 
Cost  and  Training  Effectiveness  Analysis  (CTEA)  of  TEC  in  relation  to 
unit  performance  as  demonstrated  in  an  Army  Training  and  Evaluation 
Program  (ARTE?)  evaluation  as  discussed  in  the  preceding  TEC  report. 
Because  of  TEC's  unique  complementary  role,  it  does  not  fit  the  usual 
training  program  mold,  and  analytical  techniques  available  in  current 
training  literature  are  not  completely  suitable  for  a  TEC  evaluation. 
General  guidance  for  a  TEC  CTEA  is  available;  nonetheless,  it  appears 
a  TEC-specific  evaluation  methodology  must  be  developed. 


PURPOSE 

The  purpose  of  this  research  is  to  develop  a  TEC  CTEA  Methodology 
for  determining  the  value  of  TEC  in  terms  of  unit  performance  on  the 
ARTEP  evaluation. 


APPROACH 


General .  The  overall  research  was  envisioned  as  an  extension 
of  the  CY77  TEC  CTEA  (outlined  above)  to  include  investigation  of 
the  relations  among  TEC  use  and  both  unit  and  individual  training 
costs  and  effectiveness.  The  research  would  involve  development 
of  a  TEC  CTEA  methodology,  data  collection,  and  application  of  the 
methodology  to  an  analysis  of  the  data. 

A  data  collection  plan  -  including  the  development  of  forms, 
instructions  for  their  use,  determination  of  the  types  and  numbers 
of  units  required  to  provide  data,  and  procedures  for  the  implemen¬ 
tation  of  data  collection  -  has  been  drawn.  Commencement  of  data 
collection,  however,  pends  the  identification  of  specific  units  to 
participate.  Accordingly,  the  application  of  the  methodology  to 
an  analysis  of  empirical  data  is  pending.  As  an  interim  offset, 
therefore,  the  methodology  was  applied  using  hypothetical  data. 

The  development  of  the  methodology  for  determining  the  value  of 
TEC  commenced  with  a  review  of  literature®  concerning  the  current 
state  of  the  art  in  CTEA  methods.  Although  the  review  disclosed 
no  readily  available  CTEA  methodology  suitable  for  TEC,  it  provided 
an  essential  overview  of  CTEA  requirements. 

TEC  CTEA  Requirements .  CTEA  in  general  must  involve  a  compari¬ 
son  of  the  effectiveness  and  costs  of  alternative  training  systems. 
Since  any  decision  regarding  a  modification  of  any  part  of  the  train¬ 
ing  system  must  be  made  in  consideration  of  the  effects  of  that  modi¬ 
fication  on  the  effectiveness  of  the  force  structure,  a  CTEA  must 
relate  a  (proposed  or  actual)  change  in  the  training  system  to  its 
ultimate  impact  on  combat  effectiveness.  This  means  the  CTEA  must 
be  performance-oriented.  It  also  means  that  any  proposed  alterna¬ 
tives  must  be  compared  v;ith  the  baseline  system,  v;hich  is  the  best 
currently  available  training  system.  The  comparison  can  be  of  three 
different  types:  equal  costs,  unequal  effectiveness;  equal  effective¬ 
ness,  unequal  costs;  or  unequal  costs  and  unequal  effectiveness. 

The  TEC  program  is  primarily  a  complementary,  rather  than  a  sub¬ 
stitute,  training  program.  That  it,  it  does  not  substitute  for  a 
different  training  program  (although  it  can  be  used,  selectively,  to 
substitute  for  parts  of  the  existant  training  program) .  It  is  intend 
ed  to  be  used  in  conjunction  v;ith  other  existing  programs.  This 


®Sassone , 


Literature  Review  -  Cost  and  Training  Effectiveness. 


complementary  nature  is  a  critical  point,  because  it  serves  as  a 
basis  for  evaluating  TEC  as  an  addition  to  existing  training 
programs . 

Since  TEC  is  intended  neither  as  strictly  a  cost-substitute 
program  to  increase  effectiveness  at  the  same  level  of  costs,  nor 
as  strictly  an  effectiveness-substitute  program  to  decrease  costs 
while  maintaining  effectiveness,  the  traditional  cost-effectiveness 
approach  to  training  program  evaluation  is  not  applicable.  That  is, 
it  is  not  appropriate  to  evaluate  TEC  as  though  it  were  strictly 
intended  to  minimize  costs  while  maintaining  effectiveness  or  to 
maximize  effectiveness  while  maintaining  costs.  Rather,  it  must  be 
explicitly  recognized  that  TEC  could  simultaneously  change  both 
effectiveness  and  costs.  The  issue  then  becomes:  Is  the  change  in 
effectiveness  worth  the  change  in  costs?  This  question  demands  a 
cost-benefit^,  rather  than  a  cost-effectiveness,  point  of  view. 

Accordingly,  with  account  of  the  usual  CTEA  considerations^®  and 
a  TEC  CTEA's  kinship  to  a  cost-benefit  analysis,  five  methodological 
requirements  for  a  TEC  CTEA  were  identified. 

o  the  baseline  training  system  must  be  identified 
and  its  parameters  quantified. 

o  the  training  system  inclusive  of  TEC  must  be  defined 
and  its  parameters  quantified. 

o  An  input  cost  function  must  be  developed  which  maps 
any  training  system  configuration  into  its  dollar 
cost. 

o  an  approach  must  be  devised  which  objectively  trans¬ 
lates  changes  in  effectiveness  into  corresponding 
dollar  values. 

The  development  of  a  TEC  evaluation  methodology  to  meet  the  re¬ 
quirements  is  susceptive  to  the  methods  of  microeconomics  and  welfare 
economies.  The  evaluation  procedures  are  objective,  and  result  in 
ultimate  dollar  valuation  of  the  TEC  training  concept. 


®The  cost-benefit  approach  is  sometimes  adopted  in  private  sector  studies, 
but  these  benefits  are  estimated  as  increases  in  wages.  This  approach  is 
clearly  inappropriate  for  military  applications. 

1®U.S.  Army  TRADOC  Systems  Analysis  Activity.  Cost  and  Training  Effective- 
ness  (  CTEA)  handbook.  White  Sands  Missile  Range,  New  Mexico.  Author,  1976 


Technical  Approach.  The  approach  adopted  in  the  development  of 
this  CTEA  methodology  is  an  extension  of  a  model  and  several  concepts 
from  economic  theory.  The  model  used  here  to  guide  the  choice  among 
various  types  of  training  and  to  assess  the  value  of  TEC  is  an  ex¬ 
tension  of  the  microeconomic  theory  of  the  consumer.  Basically,  we 
substitute  a  training  effectiveness  production  function  for  the  tra¬ 
ditional  utility  function,  where  the  former  has  much  the  same 
mathematical  structure  as  the  latter.  The  key  concepts  enjoyed  here 
in  developing  dollar  values  for  the  TEC  program  are  the  compensatory 
budget  variation  and  the  equivalent  budget  variation.  These  concepts 
are  central  to  theoretical  welfare  economics,  where  they  provide 
measures  of  the  welfare  effects  of  price  changes  on  consumers.  We 
extend  these  concepts  to  provide  dollar  measures  of  the  value  of 
training  programs.  The  TEC  CTEA  methodology  section  report  explains 
the  model  and  concepts  just  mentioned. 


ORGANIZATION  OF  THE  REPORT 

The  report  comprises  three  major  sections: 

o  This  introduction  is  the  first  section.  It  presents 
the  background,  states  the  objective,  outlines  the 
scope,  and  generally  describes  the  overall  approach 
of  the  investigative  effort. 

o  The  second  section  outlines  the  TEC  CTEA  methodology. 
It  discusses  the  construction  of  effectiveness 
production  functions  and  procedures  to  determine 
the  cost  of  various  types  of  training.  This 
section  discusses  the  basis  of  the  methodology 
in  economic  theory,  describes  its  adaption  to  an 
Army  Training  situation,  explicates  the  develop¬ 
ment  of  the  valuation  part  of  the  methodology, 
presents  an  algebraic  example,  and  shows  the  use 
of  the  valuation  methodology  in  a  present  value 
analysis  to  derive  an  ultimate  dollar  value  of 
TEC. 

o  The  last  section  summarizes  the  investigative 
effort  and  presents  some  further  consideration. 
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TEC  CTEA  METHODOLOGY 


The  objectives  of  this  section  are  to  develop  and  explain  a 
methodology  which  can  be  used  to  provide  an  objective  economic 
evaluation  of  the  TEC  Program,  and  very  likely,  other  military 
training  programs  as  well.  As  mentioned  above,  the  methodology 
is  based  on  modern  welfare  economics,  that  branch  of  economics 
which  deals  with  the  normative  evaluation  of  alternative  economic 
states.  The  methodology  involves  four  steps: 

o  Specification  and  estimation  of  an  Effectiveness 
Production  Function. 

o  Estimation  of  the  "per  unit"  costs  of  the  different 
types  of  training  contributing  to  overall  effective¬ 
ness,  as  well  as  determination  of  the  magnitude  of 
the  training  budget. 

o  Calculation  of  the  current  value  of  the  TEC  Program. 

o  Calculation  of  the  present  value  of  the  TEC  Program, 

Each  of  these  steps  involves  a  number  of  (sometimes  technically  com¬ 
plex)  substeps.  The  four  steps  are  discussed  in  this  section;  how¬ 
ever,  Step  3,  the  Valuation  Methodology,  is  the  heart  of  the  CTEA 
Methodology,  and  this  section  of  the  report  deals  primarily  with  the 
development  of  that  step. 


EFFECTIVENESS  PRODUCTION  FUNCTION 

The  first  step  of  the  methodology  is  to  determine  the  effective¬ 
ness  production  function.  A  valid  measure  of  unit  combat  effective¬ 
ness  must  exist  in  order  to  carry  out  the  valuation  methodology.  It 
is  assumed  that  a  unit's  performance  on  selected  missions  during  the 
Army  Training  and  Evaluation  Program  (ARTEP)  evaluation  accurately 
reflects  the  unit's  capability  to  successfully  perform  these  missions 
in  combat.  It  is  also  assumed  that  reliable  measures  of  effectiveness 
can  be  construed  for  each  ARTEP  mission;  however,  it  is  recognized 
that  an  adequate  measure  of  effectiveness  is  not  apparent  from  a 
normal  ARTEP  evaluation.  The  ARTEP  evaluation  results  in  units  being 
judged  satisfactory  or  unsatisfactory  on  selected  missions.  This 


gross  measurement  of  unit  performance  lacks  the  sensitivity  neces¬ 
sary  to  adequately  discriminate  among  the  various  types  of  individual 
and  collective  training  received  by  the  unit.  Accordingly,  some 
procedure  must  be  established  to  convert  the  ARTEP  ratings  of  satis¬ 
factory/unsatisfactory  to  a  nvimerical  measure  of  effectiveness. 
Currently,  a  scale  of  zero  to  one  is  being  utilized  for  the  measure 
of  effectiveness. 

A  precise  measure  of  relative  unit  performance  is  further  compli¬ 
cated  by  the  subjective  nature  of  ARTEP  evaluation.  Even  though 
many  standards  appear  to  facilitate  an  objective  evaluation  (time, 
distance,  numbers,  etc.),  most  pass/fail  decisions  include  considera¬ 
tions  for  visibility,  climatic  conditions,  preceding  unit  activity, 
tactical  situation,  etc.,  as  well  as  the  individual  perspective  of 
the  evaluation.  Recognizing  the  inherent  problems  of  obtaining 
reliable  unit  effectiveness  data,  experience  has  proven  that  compe¬ 
tent  evaluators,  properly  briefed,  will  provide  valid  data  and  a 
relatively  consistent  measure  of  unit  effectiveness. 

In  addition  to  a  precise  measure  of  unit  performance,  there  is 
a  requirement  to  determine  the  contribution  of  various  TEC  lessons 
to  unit  performance.  Current  TEC  lessons  are  designed  to  primarily 
teach  individual  tasks.  This  necessitates  concentration  on  ARTEP 
tasks  and  standards,  rather  than  overall  mission  performance. 

The  difference  in  ARTEP  design  will  require  that  an  effectiveness 
production  function  be  constructed  for  each  type  of  unit  undergoing 
evaluation.  Two  procedures  for  measuring  unit  performance  are  sug¬ 
gested.  Each  ARTEP  task  or  standard  may  be  equated  to  a  numerical 
effectiveness  measure  of  zero  to  10  points  -  a  seven  may  be  equal  to 
a  satisfactory  performance  while  a  higher  number  indicates  something 
better  than  the  performance  standard  (e.g.  a  five-minute  standard 
completed  in  four  minutes)  and  a  number  below  seven  would  allow  for 
some  distinction  among  units  judged  unsatisfactory.  The  procedure 
used  in  the  development  of  hypothetical  data  to  exercise  this  model 
was  to  assign  a  numerical  value  to  each  standard  or  portion  of  a 
standard  and  the  unit  performance  (output)  for  each  task  was  derived 
from  the  number  of  satisfactory  and  unsatisfactory  standards.  The 
inputs  to  the  function  are  obtained  through  the  collection  of  indi¬ 
vidual  personnel  data  (all  personnel  assigned  to  the  unit  undergoing 
evaluation)  and  the  collection  of  detailed  data  which  reflects  all 
individual  and  collective  training  activities  of  the  unit. 
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COST  OF  TFfAINING 


The  secoiAd  step  of  the  methodology  involves  determining  the 
costs  of  the  different  types  of  training  contributing  to  overall 
unit  effectiveness.  It  would  be  a  simple  task  to  determine  the 
annual  training  budget  for  an  Army  Division;  however,  a  squad’s 
share  of  t  at  budget  for  a  specific  period  of  instruction  is  not 
readily  a\iilable. 

For  tr.o  development  of  this  methodology,  training  was  divided 
into  three  categories:  TEC,  garrison,  and  field.  Data  forms  were 
developed  to  record  all  individual  and  collective  training  for  an 
eight  week  period  prior  to  the  ARTEP  evaluation.  The  collected 
data  provides  information  concerning  the  time  expenditure  of  all 
personnel  by  rank,  the  type  and  amount  of  training  each  individual 
has  attended,  the  type  of  facility  utilized,  the  type  of  vehicles 
used  and  mileage  for  each,  and  the  type  and  amount  of  all  ammuni¬ 
tion.  With  the  above  data,  using  current  cost  information,  the 
cost  of  each  type  of  training  was  determined  for  use  in  the  hypo¬ 
thetical  data.  This  provides  comparative  costs  for  a  given  amount 
of  TEC,  garrison,  and  field  training. 

No  absolute  training  budget  constraint  figure  was  used  for  the 
hypothetical  units,  but  the  budget  constraint  was  treated  as  a 
variable  and  was  a  consideration  in  all  cost  computations. 


ECONOMIC  THEORIES 

Before  commencing  a  technical  development  of  the  methodology, 
it  may  be  useful  to  briefly  summarize  the  economic  theories  on 
which  it  is  based,  which  are  the  theory  of  consumer  behavior  and 
the  theory  of  economic  welfare.  The  theory  of  consumer  behavior 
attempts  to  explain  the  behavior  of  rational  individuals  in  the 
context  of  a  market.  Individuals  are  faced  with  a  large  number  of 
available  goods,  each  with  fixed  price,  and  have  a  fixed  and 
finite  income  with  which  to  purchase  some  "market  basket"  of  goods 
The  individual  is  assumed  to  possess  a  set  of  preferences  over  all 
possible  market  baskets.  These  preferences  satisfy  four  axioms: 
greed,  completeness,  transitivity,  and  diminishing  marginal  rate 
of  substitution.  These  axioms  are  the  basis  for  the  utility 
function,  which  is  a  convenient  and  analytically  tractable  repre¬ 
sentation  of  a  consumer's  preferences.  The  theory  of  economic 


welfare  starts  from  the  preceding  theory  and  asks:  under  what  cir¬ 
cumstances  (particularly  regarding  price  and  income  changes)  is  the 
consumer  made  better  or  worse  off?  An  answer  to  this  question  is 
formulated  using  the  concepts  of  compensating  and  equivalent  vari¬ 
ations  in  income.  At  first  blush,  these  economic  theories  seem  to 
bear  little  relation  to  the  problem  of  evaluating  military  training 
programs.  Nonetheless,  the  areas  are  sufficiently  formally  parallel 
that  the  economic  theories  can  be  successfully  adapted  to  the  military 
context.  In  essence,  the  two  different  problem  areas  are  found  to 
have  similar  mathematical  structure,  and  the  methodology  to  be  des¬ 
cribed  exploits  that  similaurity- 


ARMY  TRAINING  ADAPTATION 

In  the  context  of  military  training,  we  set  up  our  model  as 
follows.  An  individual  or  unit  (squad,  platoon,  company,  battalion, 
etc.)  has  a  number  of  missions  for  which  it  is  responsible.  There 
are  a  number  of  different  types  of  training  activities  in  which  the 
unit  can  engage,  and  each  type  of  training  activity  makes  some  con¬ 
tribution  to  the  ability  of  the  unit  to  carry  out  each  mission.  To 
be  sure,  certain  types  of  training  may  enhance  ability  in  one  mission 
area  more  than  in  another.  The  amount  of  each  training  activity 
undertaken  by  the  military  unit  is  measurable  in  appropriate  units 
such  as  hours  or  trials.  The  overall  ability  and  proficiency  with 
which  the  unit  carries  out  its  assigned  missions  is  referred  to  as 
the  unit's  effectiveness,  and  we  assume  a  valid  measure  of  group 
effectiveness  exists  or  can  be  constructed.  The  costs  of  carrying 
out  each  type  of  training  are  also  assumed  to  be  known,  and  the  unit's 
training  budget  is  assumed  known  and  fixed  (for  the  current  training 
period) . 

Suppose  a  new  training  concept  is  developed  and  is  considered 
for  introduction  into  this  milieu.  A  procedure  is  needed  to  determine 
whether,  and  to  what  extent,  the  new  training  concept  is  economically 
viable.  The  basic  approach  is  to  determine  whether  the  present  value, 
of  the  sum  of  the  net  values  of  the  new  training  to  each  military 
unit  utilizing  that  training  over  the  "lifetime"  of  the  training 
program  exceeds  the  development  cost  of  the  training  program.  The 
key  to  implementing  the  approach  is  the  determination  of  the  net 
value  of  the  new  training  to  the  unit  using  it.  This  can  be  accom¬ 
plished  using  either  one  of  two  concepts  from  welfare  economics. 


The  first  is  the  compensating  budget  variation .  Here  one  attempts 
to  determine  the  maximum  training  budget  reduction  a  unit  can  suffer 
in  the  presence  of  the  new  training  program  which  still  permits  the 
previous  level  of  effectiveness  -  the  level  reached  with  the  initial 
budget  and  no  new  training  -  to  be  achieved-  The  second  concept  is 
the  equivalent  budget  variation.  Here  one  attempts  to  determine  the 
minimum  training  budget  increase  which  a  unit  must  receive  to  achieve 
the  same  increase  in  effectiveness  without  the  new  training  program 
as  can  be  achieved  with  the  initial  budget  and  with  the  new  training 
program.  Under  certain  conditions,  the  compensating  budget  variation 
and  the  equivalent  budget  variation  are  numerically  equivalent.  More 
generally,  however,  they  have  different  values. Which  of  the  two 
concepts  provides  the  more  appropriate  measure  of  the  value  of  the 
new  training  program  depends  on  the  objective  of  the  organization. 

If  the  objective  is  to  minimize  the  cost  of  achieving  the  current 
level  of  effectiveness,  the  compensating  budget  variation  is  more 
appropriate.  If  the  objective  is  to  increase  effectiveness  while 
maintaining  the  initial  budget  level,  the  equivalent  budget  varia¬ 
tion  is  more  appropriate.  To  the  extent  that  the  organization's 
objective  is  uncertain,  or  to  the  extent  it  combines  both  mentioned 
objectives,  a  weighted  average  of  the  two  variations  can  be  used. 

The  numerical  values  of  both  the  compensating  and  equivalent 
budget  variations  can  be  derived  from  the  effectiveness  production 
function  and  the  unit's  training  budget  constraint.  The  effective¬ 
ness  production  function  is  the  relationship  between  the  inputs  and 
output  of  the  training  process.  The  inputs  are  the  various  types 
and  amounts  of  training  the  unit  receives,  along  with  the  relevant 
attributes  of  the  unit  itself  (such  as  intelligence  and  prior  train¬ 
ing)  and  the  output  is  the  assumed  objective  and  measurable  charac¬ 
teristic  effectiveness.  The  training  budget  constraint  is  the  re¬ 
lationship  among  the  dollar  value  of  the  training  budget,  the  unit 
costs  of  the  various  types  of  available  training,  and  the  quantities 
of  each  type  of  training  which  can  be  afforded. 

The  training  budget  constraint  is  a  linear  function  and  is  con¬ 
ceptually  straightforward.  The  effectiveness  production  function, 
on  the  other  hand,  is  (in  general)  non-linear  and  is  rich  in  possible 
specifications.  In  considering  the  impact  on  the  production  function 
of  the  introduction  of  a  new  training  program,  there  appear  to  be  four 
distinctly  different  ways  in  which  a  new  program  can  affect  effective¬ 
ness.  First,  the  new  program  can  influence  effectiveness  in  the  same 


^^The  reason  for  this  asymmetry,  which  was  first  pointed  out  by 
A.  Henderson  ("Consumers  Surplus  and  the  Compensating  Variation," 
Review  of  Economic  Studies,  1941,  is  somewhat  technical  and  un¬ 
important  for  present  purposes 


way  that  every  other  program  does,  i-e.,  it  is  simply  another  among 
many  training  programs.  Second,  the  new  program  can  enhance  or 
augment  the  effect  of  one  or  several  of  other  training  programs, 
i.e.,  it  can  make  it  seem  like  more  of  some  other  training  is  being 
received  than  is  actually  the  case.  Third,  the  new  program  can 
uniformly  augment  all  the  other  training,  i.e.,  it  can  raise  the 
entire  effectiveness  production  function.  Finally,  the  new  train¬ 
ing  program  can  increase  the  substitutability  of  one  type  of  train¬ 
ing  for  another,  permitting  some  of  a  less  costly  type  of  training 
to  be  svibstituted  for  some  of  a  more  costly  type  of  training  while 
maintaining  the  same  level  of  effectiveness. 

The  effectiveness  production  function  must  be  empirically  deter¬ 
mined.  Multiple  regression  analysis  is  the  logical  starting  point 
for  this  estimation  process.  The  observations  (data  points)  may  be 
cross-sectional  or  longitudinal,  or  perhaps  a  pooled  sample.  The 
regressand  is  the  effectiveness  measiire  achieved  by  the  unit.  The 
regressors  would  be  the  amounts  of  each  type  of  training,  as  well  as 
such  standardizing  variables  as  intelligence  and  prior  training, 
relevant  to  each  effectiveness  observation. 

The  training  budget  constraint,  unlike  the  effectiveness  pro¬ 
duction  function,  need  not  be  empirically  estimated,  but  can  be 
constructed  using  available  data. 


DEVELOPMENT  OF  THE  VALUATION  METHODOLOGY 


Assumptions .  At  this  point  we  begin  a  somewhat  rigorous  develop¬ 
ment  of  the  Valuation  Methodology,  which  is  the  third  of  the  four 
steps  comprising  this  CTEA  Methodology.  We  start  with  the  following 
assumptions. 

°  Military  training  is  carried  out  as  a  rational  re¬ 
source  allocation  process.  The  trainer  behaves 
as  if  he  knows  the  effectiveness  production  func- 
tion^2  (the  relation  between  inputs  and  outputs  of 
the  training  process) ,  he  knows  the  costs^^  of  the 
various  types  of  training,  he  knows  his  training 
budget,  and  he  attempts  to  maximize  the  effectiveness 
he  can  achieve  in  his  charges  subject  to  his  cost  and 
budget  constraints. 

°  There  exists  a  measure  of  unit  effectiveness. 


The  trainer  may  have  an  implicit  knowledge  of  the  effectiveness 
function.  That  is,  while  he  may  not  be  able  to  state  the  mathema¬ 
tical  form  of  the  function,  he  behaves  -  in  his  resource  allocation 
choices  -  as  though  he  knows  it.  This  is  similar  to  the  pocket 
billiards  expert  who  may  have  no  explicit  knowledge  of  the  principles 
of  mechanics,  but  surely  behaves  as  though  he  does.  Step  1  of  the 
CTEA  Methodology  involves  the  explicit  estimation  of  the  effective¬ 
ness  production  function. 


^  As  in  the  previous  footnote,  it  is  sufficient  to  assume  the  trainer 
has  an  implicit,  or  behavioral,  knowledge  of  these  costs.  Step  2 
of  the  CTEA  Methodology  involves  the  explicit  determination  of  the 
unit  costs  of  each  type  of  training, 
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°  The  effectiveness  production  function  is  a  known,  con¬ 
tinuous,  differentiable,  strictly  quasi-concave  function 
with  domain  and  range  the  nonnegative  real  numbers. 

°  The  unit  costs  of  each  type  of  training  are  known,  as 
is  the  total  amount  of  the  training  budget. 

°  There  are  I  (greater  than  one)  different  types  of  train¬ 
ing  available,  not  including  the  new  training  which  is 
the  subject  of  the  evaluation. 

Of  these  ^ive  assumptions,  only  the  third  demands  elucidation  at  this 
point,  the  others  being  sufficiently  self-explanatory. 

We  begin  with  a  definition.  The  effectiveness  production  function 
(EPF)  is  the  relation  between  any  given  amounts  of  any  types  of  avail¬ 
able  training  and  the  maximum  level  of  effectiveness  which  that  train¬ 
ing  can  achieve,  given  the  levels  of  experience,  intelligence,  etc.  of 
the  units  being  trained.  An  example  of  an  EPF  might  be  E  =  Tj^®  T2^  A 
where  E  =  effectiveness,  Tj^  and  T2  are  numerical  measures  of  the  amounts 
of  two  types  of  training  received,  A  is  a  combined  measure  of  experience 
and  intelligence,  and  a,  a,  and  3,  are  positive  parameters. 

Assumption  3  states  the  EPF  is  known.  In  order  to  carry  out  the 
Valuation  Methodology,  this  must  be  the  case.  Determining  the  EPF  is 
Step  1  in  the  CTEA  Methodology. 


The  EPF  is  assumed  to  be  continuous.  This  simply  means  there 
is  an  effectiveness  level  associated  with  all  values  of  the  training 
variables  within  the  relevant  range.  Differentiable  means  the  func¬ 
tion  has  derivatives  everywhere,  there  are  no  kinks  or  corners  in  the 
function.  That  the  EPF  is  strictly  quasi-concave  means  its  contours 
(iso-effectiveness  surfaces)  are  strictly  convex  to  the  origin.  A 
nonnegative  range  and  domain  of  the  EPF  simply  means  the  values  taken 
by  inputs  and  the  output  of  the  function  cannot  be  negative. 

The  following  figures  give  three  different  perspectives  on  the 
EPF.  In  general,  one  can  expect  an  EPF  to  have  a  form  like  that 
suggested  by  the  figures,  although  deviations  cannot  be  ruled  out 
a  priori.  The  reader  might  bear  in  mind  that  there  are  an  infinite 
number  of  mathematical  specifications  of  the  EPF  consistent  with  the 
displayed  form,  so  these  figures  do  not  obviate  the  need  for  Step  1 
of  the  CTEA  Methodology.  Figure  1  displays  a  cross-sectional  view  of 
the  EPF.  Holding  all  other  variables  constant,  it  shows  the  relation 
between  one  type  of  training  and  unit  effectiveness.  Three  points  are 
noteworthy.  First,  zero  amount  of  training  does  not  imply  zero  effec¬ 
tiveness.  This  is  because  the  other  factors  affecting  effectiveness, 
held  constant  for  the  purpose  of  this  Figure,  contribute  to  the  unit's 
effectiveness.  Even  if  none  of  this  particular  type  of  training  is 
received,  the  unit  can  exhibit  a  positive  level  of  effectiveness,  such 
as  A.  Second,  the  curve  in  the  figure  approaches  the  effectiveness 
value  B  asymptotically.  This  means  there  is  a  maximum  level  of  effec- 


tiveness  which  can  be  produced  from  any  amount  of  this  type  of 
training,  given  the  fixed  levels  of  the  other  factors.  This  assump¬ 
tion  is  in  good  accord  with  both  the  economic  theory  of  production 
functions  and  psychological  theories  of  training.  Third,  the  curve 


in  Figure  1  is  non-decreasing  as  the  level  of  training  increases. 

In  other  words,  more  training  never  causes  a  decrease  in  effective- 


Figure  2  shows  an  alternate  cross-sectional  view  of  the  EPF. 

Holding  all  factors  constant  except  for  two  types  of  training,  the 
Figure  shows  all  combinations  of  the  two  types  of  training,  other 
factors  constant,  which  can  lead  to  a  given  level  of  effectiveness. 

The  two  curves  shown  in  the  figure  correspond  to  two  different  levels 
of  effectiveness,  the  greater  effectiveness  being  associated  with  the 
more  north-easterly  curve.  These  curves  can  be  referred  to  as  iso¬ 
effectiveness  contours,  and  there  are  four  noteworthy  points  about 
these  contours.  First,  they  slope  downward  from  left  to  right.  This 
indicates  that  one  type  of  training  can  be  substituted  for  another  to 
maintain  a  given  level  of  effectiveness.  Second,  the  contours  are 
non-intersecting.  If  intersections  occurred,  this  would  imply  that 
both  contours  were  associated  with  the  same  effectiveness  level,  which 
would  be  a  contradiction.  Third,  the  contours  are  convex  to  the  origin, 
i.e.,  their  slopes  increase  to  the  right.  This  means  that  as  one  type 
of  training  is  substituted  for  another,  it  takes  more  and  more  of  the 
increasing  type  of  training  to  compensate  for  unit  decreases  in  the 
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other  type  training  if  the  initial  level  of  effectiveness  is  to 


be  maintained.  The  fourth  point  is  that  the  iso-effectiveness 


contours  may  or  may  not  intersect  the  axes.  Typically  one  might 


expect  the  contours  associated  with  the  lower  effectiveness  levels 


to  intersect  the  axes  while  the  higher  contours  may  not.  This 


means  that  for  lower  effectiveness  levels  (say  E)  some  types  of 


training  may  be  dispensed  with  entirely  (other  types  substituting) 


and  that  level  of  effectiveness  maintained.  For  high  levels  of 


effectiveness  (say  E) ,  at  least  some  amount  of  certain  types  of 


training  may  be  indispensable  if  that  effectiveness  level  is  to  be 


maintained . 


Figure  3  is  a  three  dimensional  view  of  the  EPF.  It  combines 


the  views  of  the  previous  two  figures.  Holding  all  variables  con¬ 


stant  except  two  types  of  training  and  effectiveness,  the  EPF  can 


be  represented  as  surface  ADE.  A  is  greater  than  0  here  as  in  Figure 


1.  As  T;L  increases  with  T2  =  0,  the  value  of  effectiveness  asymptoti¬ 


cally  approaches  B.  Likewise,  as  T2  increases  with  Tj^  =  0,  the  value 


of  effectiveness  asymptotically  approaches  C.  If  effectiveness  is 


fixed  at  level  E,  locus  GF  is  the  iso-effectiveness  contour  represent¬ 


ing  all  combinations  of  Ti  and  T2  yielding  E.  JH  is  the  projection  of 


GF  onto  the  plane  of  Ti  and  T2  ,  represented  in  Figure  2. 


beui 
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Effectiveness 


Figure  3.  Three  Dimensional  View  of  the  Effectiveness  Production 
Function . 


The  Model .  We  are  now  prepared  to  construct  the  economic  model 
of  training  resource  allocation,  which  is  the  basis  for  the  CTEA 
Methodology.  We  employ  the  following  notation. 

E  a  unit's  level  of  overall  effectiveness 

the  quantity  of  training  of  type  i  received  by 
the  unit ,  i  =  1  ...  I 

T*  the  quantity  of  the  new  training  program  re¬ 

ceived  by  the  unit 
Cj^  the  per  unit  cost  of 

c*  the  per  unit  cost  of  T* 

B  the  dollar  amount  of  the  unit's  training  budget 

A  all  other  factors  affecting  the  unit's  mission 

prof iciency 

C(T*)  the  compensating  budget  variation  associated  with 
T* 

E(T*)  the  equivalent  budget  variation  associated  with  T* 

V(T*)  the  net  value  of  T*  to  the  unit. 

In  what  follows  we  employ  an  implicit  form  of  the  EPF,  in  order  to  make 
our  development  of  the  CTEA  methodology  as  general  as  possible.  Of 
course,  in  an  actual  application,  a  specific  EPF  would  be  employed. 

Denote  the  EPF  as 

E  =  F  (  Ti,  T2,  ...  Ti,  a  ).  (1) 

Remember  that  E=F(‘)  incorporates  all  the  assumptions  about  the  EPF 


mentioned  previously.  The  trainer's  objective  is  to  maximize  E,  but 
he  is  constrained  by  limited  resources.  Specifically,  his  choices 
over  the  Ti,  T2,  ...>  Tl  (his  control  variables)  must  obey  (assuming 
he  spends  his  entire  training  budget,  B) 

B  =  +  C2  T2  +  -  +  cj  Tj  (2) 

and 

-  0,  Yi  (3) 

Equation  (2)  states  the  trainer  can  spend  only  as  much  budget  as  he 
has,  and  (3)  is  merely  a  technical  statement  that  the  amount  of  train¬ 
ing  of  any  type  cannot  be  a  negative  number.  Equations  (1),  (2),  and 
(3)  constitute  a  nonlinear  programming  problem.  Since  this  is  the 
resource  allocation  problem  providing  the  foundation  for  our  CTEA 
Methodology,  some  investigation  into  its  characteristics  is  useful. 
Specifically,  let  us  characterize  the  solution  to  the  problem  and  then 
investigate  the  effects  of  changes  in  parameter  values  (B,  ...)  on 

the  solution. 

The  method  of  Lagrange  Multipliers^**  is  a  useful  solution  technique 
for  maximizing  (1)  subject  to  (2)  and  (3) .  Form  the  function 

L  =  F  (T]^,  T2,  ...,  T  )  +  A  (B-C]^Tj^-  C2T2-  ...  -  . 

First  order  conditions  for  a  maximum  are 

See  almost  any  text  on  advanced  calculus. 


The  first  I  conditions  in  (4)  can  be  reduced  to  the  I-l  conditions 


*^i  ,  for  i  =  1  to  I-l 

c 


For  the  two  variable  case,  the  right  side  of  (5),  Cj^/c2,  is  simply 
the  negative  of  the  slope  of  (2)  in  Tj^T2  space.  The  meaning  of 
the  left  side  of  (5)  can  be  seen  as  follows.  For  the  two  variable 
case  the  total  differential  of  (1)  is 

^^2- 

Along  an  iso-effectiveness  contour  dE  =  0,  so  that 

dT  8F/9Ti 

_ 2  ^  _  1- 

dTj^  9F/9T2 

Therefore,  the  left  side  of  (5)  is  the  negative  of  the  slope  of  the 
optimal  iso-effectiveness  contour.  It  follows  that  (5)  implies  that 
the  optimal  values  of  Tj^  and  T2  are  such  that  at  that  point  the  slope 
of  the  iso-effectiveness  contour  equals  the  slope  of  the  budget  con¬ 
straint.  Moreover,  according  to  the  I+lst  condition  in  (A),  the 


optimal  and  T2  must  be  on  the  budget  constraint.  Figure  4 
summarizes  these  conclusions  by  graphically  illustrating  the 
solution  to  the  two  variable  problems.  The  solution  occurs  where 
the  highest  iso-effectiveness  contour  has  a  point  in  common  with 
the  budget  line.  Tangency  of  the  two  lines  occurs  at  that  point. 

Note  that  the  rationale  for  the  assumption  of  strict  quasi¬ 
concavity  of  the  EPF  is  now  evident.  Strictness  insures  that  the 
iso-effectiveness  contour  has  no  linear  segments.  If  it  exhibited 
linearity,  the  optimum  solution  either  could  be  indeterminate  (if 
the  iso-effectiveness  line  and  the  budget  line  happened  to  have  the 
same  slope)  or  could  occur  at  a  corner,  such  as  at  (T^^,  T2)  = 

(B/c^,  0)  or  (0,  B/C2).  The  corner  solution  is  the  most  likely 
event,  yet  is  not  plausible  in  most  cases.  Thus,  the  assumption 
of  strict  quasi-concavity  of  the  EPF  helps  rule  out  the  implausible 
event,  and  helps  the  model  conform  (presumably)  more  closely  to 
reality. 

As  a  check  on  the  reasonableness  of  the  model,  and  as  a  way  of 
investigating  its  characteristics,  we  can  determine  the  model's  im¬ 
plications  for  training  resource  allocation  when  (a)  the  per  unit 
cost  of  one  type  of  training  changes;  or  (b)  the  training  budget 
changes.  Both  these  situations  can  be  investigated  with  the  aid  of 
diagrams  akin  to  Figure  4.  Suppose  we  begin  with  the  solution  es- 


tablished  in  Figure  4  and  then  assume  an  increase  to  cj^(the  per  unit 
cost  of  T^)  occurs,  but  B  and  C2  remain  constant.  An  increase  in  cj^ 
means  that  B/cj^  decreases,  which  means  that  the  budget  constraint 
rotates  (about  B/C2)  inward.  Figure  5  illustrates  this  change  in  the 
budget  constraint,  and  the  tangency  of  a  lower  iso -effectiveness  con¬ 
tour  to  the  new  constraint  line.  Figure  6  isolates  the  effect  of  the 
change  in  the  per  unit  cost  of  on  the  amount  of  which  is  optimally 
employed.  In  almost  all  cases^^  ,  the  optimal  level  of  declines  with 
Increase  in  ci.  In  this  case,  the  optimal  level  of  goes  from  to 
Tj^.  Many  points  like  (Tj,  Cj^)  can  be  generated  by  arbitrarily  changing 
c^  in  Figure  5,  and  tracing  the  effect  in  Figure  6.  The  locus  formed 
by  all  such  points  (in  Figure  6)  would  be  known  as  the  training  demand 
curve  for  T]^.  D  in  Figure  6  is  such  a  curve,  here  drawn  from  only 
two  points.  The  do^mward  slope  at  D  reflects  the  law  of  demand,  which 
states  that  there  is  an  inverse  relation  between  the  unit  price  of  a 
good  and  the  quantity  which  v-zill  be  demanded.  The  law  of  demand  is  a 
fundamental  concept  in  microeconomic  theory. 

Now,  beginning  again  from  Figure  4,  consider  the  effect  of  an  in¬ 
crease  in  the  training  budget  on  Tj^  (the  effect  on  T2  could  just  as 
easily  be  considered) .  An  increase  in  B  shifts  the  budget  constraint 
outward,  but  parallel  to  the  initial  constraint.  The  effect  of  the 
shift  on  the  optimal  level  of  T^  cannot  be  predicted  without  detailed 
information  on  the  shape  of  the  iso-effectiveness  contours.  The  optimal 


That  is  for  almost  all  sets  of  convex  iso-effcctiv'eness  contours. 
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level  of  could  increase,  decrease  ,  or  remain  unchanged  as  B 
increases.  Figures  7,  8,  and  9  illustrate  these  possibilities. 
In  each  figure  B  represents  the  initial  budget  line,  and  B'  the 
new  budget  line.  represents  the  initial  optimal  value  of 

T^,  and  the  new  optimal  value;  I*  and  I  are  the  initial  and 
final  iso-effectiveness  contours. 


The  characteristics  of  the  model  revealed  in  equations  (4)  and 
(5),  and  in  Figures  4,  5,  and  6  parallel  the  characteristics  of  the 
standard  microeconomic  theory  of  the  consumer.  The  latter  having 
withstood  a  good  deal  of  initial  investigation,  it  is  not  imprudent 
to  accept  the  reasonableness  of  the  former,  and  use  it  as  the  basis 
of  the  valuation  methodology. 


decrease  could  occur  in  one  type  of  training  if  that  training 
were  inexpensive  but  not  very  effective.  An  increase  in  the 
training  budget  could  cause  the  trainer  to  substitute  more  costly, 
but  more  effective,  training  for  that  initial  training.  Thus,  one 
might  observe  a  decrease  in  a  certain  type  of  training  associated 
with  an  increase  in  another  type  of  training. 


Figure  7.  An  increase  in  Budget 
causes  an  Increase  in 


Figure  8.  An  Increase  in  Budget 
causes  a  Decrease  in 


Figure  9.  An  Increase  in  Budget 
causes  no  change  in 


The  V'-iluation  Methodology.  Having  presented  our  model  of  train¬ 
ing  resource  allocation,  we  are  now  prepared  to  develop  the  training 
valuation  methodology.  The  methodology  exploits  the  economic  aspects 
of  the  resource  allocation  model  to  infer  the  economic  value  of  a 
specific  type  of  training. 

Suppose  our  interest  in  a  new  type  of  training  program  T*,  whose 
per  unit  cost  is  c* .  At  issue  is  whether,  and  to  what  extent,  the 
benefits  derived  from  T*  exceed  the  costs.  Or  in  other  words,  is  the 
net  value  of  the  T*  training  program  positive,  negative,  or  zero?  In 
yet  other  words,  are  we  economically  better  or  worse  off  by  having  the 
T*  training  program? 

These  questions  can  be  answered  by  calculating  the  compensating 
budget  variation  and/or  the  equivalent  budget  variation  associated 
with  T* .  These  concepts  were  developed  in  the  field  of  welfare  econo¬ 
mics  to  measure  the  impact  on  consumers  of  price  changes.  Our  use  of 
the  concepts  here  extends  their  applicability  beyond  the  measurement 
of  price  effects  to  the  measurement  of  the  value  of  training  programs. 

The  compensating  budget  variation  may  be  defined  as  the  reduction 
in  the  initial  training  budget  which  will  maintain  the  initial  level 
of  effectiveness  when  the  new  type  of  training  is  introduced  where 
the  initial  effectiveness  level  was  achieved  with  the  initial  budget 
level  but  without  the  new  training  program. 


This  concept  of  compensating  budget  variation  can  be  clarified 


by  resorting  to  the  symbolic  notation  introduce!  above.  Let  B  denote 
the  initial  training  budget  level,  and  I  the  initial  number  of  train¬ 
ing  programs.  The  trainer's  resource  allocation  problem  is,  using 
(1),  (2),  and  (3)  introduced  above. 

MAXIMIZE  E  =  F  (T^,  T^,  ...,  T^,  A)  (1) 

given  that  B  =  c^^  T^^  +  C2  T2  +  • .  -  +  T^  (2) 

T  -  0  ,  Vi  (3) 

Let  us  denote  the  solution  to  this  problem  as  (Tj^,  T2,  ...,  ,  which 

results  in  an  effectiveness  level  E. 

Now  suppose  a  new  type  of  training,  T^,  is  introduced,  with  unit 
cost  .  The  trainer  is  free  to  use  as  much  or  as  little  of  T^  as  he 
chooses  (subject  to  c^  and  B) .  How  much  of  the  budget  can  now  be  saved 
by  incorporating  T^  into  the  training  schedule?  We  answer  this  by  find¬ 
ing  the  minimum  budget  which  will  permit  E  to  be  achieved. 

Anlytically,  the  problem  is 

MINIMIZE  B  =  c  T  +  c  +  ...  +  c  T  -t-  T^(4) 

11  22  II 


given  that  E  =  F  (T^,  T2,  T^,  T^ ,  A) 


T^,  T*  ^  0,  Vi 


Denote  the  solution  to  this  problem  as  (Tj,  T2,  ...  ,  Tj,  T*) ,  and  the 
corresponding  minimized  budget  value  as  B.  Then  the  savings  achieved 
by  the  use  of  T*  in  the  achievement  of  E  level  of  E  are  B  -  B.  The 
quantity  is  known  as  the  compensating  budget  variation  associated  with 
Tji; ,  which  we  denote  as  C(T*)  .  Tliat  is 

C  (T^^)  =  B  -  B.  (7) 

31 


A) 

(1) 

+  Tj 

(2) 

(3) 

1 

»  T2  J  •  *  •  > 

T^) ,  which 

We  note  that  C  (T*)  is  necessarily  non-negative.  For  the  maximum 
value  of  B  in  (4)  is  B  achieved  by  setting  =  0.  If  is  brought 
into  the  solution  at  a  positive  level,  it  cannot  be  a  detriment  to 
the  value  of  B,  otherwise  it  simply  would  remain  at  0.  In  other 
words,  if  is  not  useful  in  cutting  costs  and  maintaining  effec¬ 
tiveness,  it  \7ill  not  be  used.  It  can  help,  but  it  can't  do  any 
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harm.  Therefore,  if  the  maximum  value  of  B  is  B,  the  minimum 

value  of  C  (T*)  is  0. 

The  compensating  budget  variation  is  an  appropriate  measure  of 
the  value  of  a  training  program  when  the  goal  of  that  new  training 
is  to  save  money,  that  is,  when  the  new  training  is  neither  expected 
nor  desired  to  result  in  an  overall  increase  in  effectiveness.  Wlien 
an  implicit  or  explicit  goal  of  the  now  training  is  to  enhance  effec¬ 
tiveness,  not  simply  to  cut  costs,  the  compensating  budget  variation 
alone  is  not  an  appropriate  measure  of  training  value.  The  appropriate 
measure  in  this  latter  case  must  include  the  equivalent  budget  variation, 
which  measures  the  value  of  the  increased  effectiveness  attributable  to 
the  new  training  program  as  the  minimum  incremental  cost  of  achieving 
the  higher  level  of  effectiveness  without  the  new  training  program. 

Once  again,  resort  to  symbolic  notation  may  clarify  the  issue.  If 
T^  is  introduced  into  the  training  milieu,  and  the  initial  budget 

1  7 


At  this  point  the  development  cost  of  has  yet  to  be  considered. 


**!-»«*  I 


level  B  prevails,  the  resource  allocation  problem  is 


MAXIMIZE  E  =  F  (T^,  T^,  ...  ,  T^,  ,  A) 


given  that  B  =  Cj^  +  *^2  "^2  ^  ^  ^ 


Tj,  ,  T*  -  0,  Vi 


The  reader  will  note  that  problem  (8),  (9),  (10)  is  different  from 


problems  (1),  (2),  (3)  and  (4),  (5),  (6).  Denote  the  solution  to 


(8),  (9),  (10)  as  T^,  T^,  ,  T^.,  ,  with  resultant  effectiveness 


E.  Then  solve 


MINIMIZE  B  =  Tj^  +  ^2  '^2  '^I 


given  that  E  =  F  (Tj^,  T2,  ...  ,  T^,  A) 


T^  -  0  Vi 


Denote  the  solution  to  this  problem  as  T^ ,  T2 ,  ...  ,  T^,  and  the 


resulting  minimized  budget  value  as  B.  Then,  the  equivalent  budget 


variation  is 


E  (T.)  =  B  -  B 


Note  that  E  (Tj,,)  must  be  non-negative.  A  comparison  of  (1),  (2),  and 


(3)  Vvfith  (8),  (9),  and  (10)  reveals  the  only  difference  is  that  the 


latter  problem  allows  the  possibility  of  using  T* .  The  extreme  worst 


case  would  be  T^  =  0,  which  would  mean  that  E  would  be  equal  to  E.  In 


that  case,  the  solution  to  (11),  (12),  (13)  would  be  B  =  B,  and  E  (T^) 


lid  be  0.  If  the  extreme  worst  case  does  not  prevail,  i.e.  T^>  0, 


then  E  (T... )  >0. 


There  is  no  necessary  relation  between  the  magnitudes  C(T  )  and 


E  (T.),  that  is,  C  (T.)  >  E  (T. )  .  However,  if  V  (T^.)  is  defined  as 


the  best  estimate  of  the  value  of  T^ ,  we  should  have 


r- r.  v  ^ 


(15) 


V  (T,^)  =  A-C  (T^.)  +  (1-A)  .  E  (T*) 
for  0  -  A  -  1. 

That  is,  V  (T*)  should  be  chosen  so  it  falls  between  C  (T*)  and  E 
(T*) ,  inclusively.  A  is  a  weight  denoting  the  relative  importance  of 
the  cost  saving  objective  in  the  introduction  of  T* .  (1  -  A)  is  the 
weight  associated  with  the  effectiveness  enhancement  objective  of  T* . 
To  allay  the  reader's  concern  that  the  introduction  of  A  necessarily 
causes  V  (T*)  to  span  so  broad  a  range  as  to  mitigate  its  usefulness, 
we  note  here  that  for  a  broad  and  useful  class  of  effectiveness  pro¬ 
duction  functions,  C  (T*)  =  E  (T*) .  Thus,  V  (T*)  can  be  independent 
of  A.  For  other  types  of  EPF's,  C  (T*)  and  E  (T*)  can  be  reasonably 


Three  Geometric  Expositions  of  the  V'aluation  Methodolo 


appreciation  of  the  methodology  developed  in  the  previous  section 
can  be  gained  by  considering  several  geometric  interpretations.  Each 
geometric  interpretation  makes  slightly  different  assumptions  in  ab¬ 
stracting  the  essence  of  the  model  to  achieve  a  two  dimensional 
interpretation.  In  the  first  interpretation  we  assume  there  are  two 
types  of  training  and  T2)  in  addition  to  the  new  training  T* .  We 
also  assume  that  while  and  T2  have  positive  unit  costs,  and  C2  , 
the  unit  cost  of  c^,  is  zero.  In  Figure  10,  the  line  designated 

is  the  initial  budget  constraint.  That  is,  is  the  line  determined 
by  the  equation  ¥  =  c^^  T^^  +  C2  T2.  The  curved  lines  are  the  iso¬ 
effectiveness  contours  of  the  production  function.  The  initial  optimal 
solution  is  Tj^,  T2  yielding  E  =  E,  when  T^.  =  0.  When  T^,.  becomes  avail- 
able  a  new  optimization  results  in  solution  values  T^^,  T2,  yielding  E 
at  point  D.  E  can  be  achieved  with  T^  >  0  at  point  K  with  a  budget  of 
B.  E  can  be  achieved  without  T*  (T*  =  0)  only  by  expanding  the  budget 
to  B,  causing  a  solution  at  M.  Then  we  can  determine  C  (T*)  =  B  -  B 
and  E  (T*)  =  B  -  B. 

Alternatively,  we  can  assume  there  is  only  one  other  type  of  train¬ 
ing  beside  T* ,  and  that  T*  has  unit  cost  to  the  group  of  .  Figure  11 
represents  this  abstraction.  Initially,  with  budget  B  and  only  training 
type  Tj^  available,  the  group  receives  T^^  =  B/cj^  units  of  Tj^,  resulting 
in  an  effectiveness  level  of  E.  When  T^  becomes  available,  the  new 


optimum  training  package  is  denoted  by  A,  resulting  in  a  higher 
effectiveness  level  of  E.  E  can  be  achieved  with  with  a  budget 
of  only  B,  as  indicated  by  point  D.  And  E  can  be  achieved  without 

only  with  the  greater  budget  of  B,  as  indicated  along  the  verti- 

—  o  ^  — 

cal  axis.  Once  again,  C(T  )  =  B  -  B,  and  E(Tj^)  =  B  -  B. 

Finally,  we  can  avail  ourselves  of  what  might  be  referred  to 
as  the  Effectiveness  Cost  Function  (ECF)  ,  a  relationship  between  the 
budget  expenditure  and  the  level  of  effectiveness,  showing  the  great¬ 
est  level  of  effectiveness  which  can  be  achieved  with  any  given 
budget  level.  In  Figure  12,  the  lower  curve  is  the  ECF  when  is 
unavailable,  and  the  upper  curve  is  the  ECF  with  .  In  this  repre¬ 
sentation,  we  can  assume  an  arbitrary  number  of  training  types  besides 
T^,  as  well  as  an  arbitrary  unit  cost  of  Initially  the  budget 

level  is  B,  T*  is  unavailable,  and  the  resulting  effectiveness  level 
is  E.  When  T*  is  introduced,  the  same  budget,  B,  can  now  achieve  E. 

The  initial  effectiveness  level,  E,  can  now  be  achieved  with  the  lower 
budget,  B.  And,  in  the  absence  of  T*,  E  could  be  achieved  only  by  ex- 
pending  the  budget  to  B.  Again,  C(T^)  =  B  -  B,  and  E(T^)  =  B  -  B. 


ALGEBRAIC  EXAMPLE  OF  THE  VALUATION  METHODOLOGY 


The  purpose  here  is  to  illustrate  the  calculation  of  the  compen¬ 
sating  budget  variation  and  the  equivalent  budget  variation  for  a 
given  effectiveness  production  function  and  a  given  budget  constraint. 


For  the  given  effectiveness  production  function  consider  there 
are  tt.?o  types  of  conventional  training  -  garrison  training  and  field 
training  -  and  TEC  training,  the  new  training,  the  value  of  which  is 
to  be  determined.  Consider,  also,  a  single  variable  A  represents  the 
effectiveness  of  a  unit  based  on  "all  other  factors"  before  the  unit 
commences  conventional  training  and  TEC  training,  and  another  variable 
E  represents  the  effectiveness  of  a  unit  based  on  its  ARTEP  or  other 
evaluation  after  the  unit  personnel  have  received  conventional  and 
TEC  training.  Consider,  further,  that  for  a  number  of  like  units, 
say  k,  over  the  course  of  their  training  periods,  data  are  collected 
from  which  to  determine  for  each  unit 


°  the  number  of  hours  expended  on 
each  of  the  three  types  of  training 


°  a  numerical  value  (range  0-1)  for  A, 
and  a  numerical  value  (range  0-1) 


Finally,  consider  that  several  candidate  effectiveness  production 
functions  are  used  in  regression  or  other  analyses  of  the  k  data 
points,  and  that  the  best  "fit"  EPF  is 


where  G,  T,  and  F  are  variables  representing  hours  of  garrison,  TEC, 
and  field  training;  g,  t,  and  f  are  parameters  representing  learning 
rates  associated  with  the  respective  types  of  training;  m  is  the 
maximum  level  of  effectiveness  a  unit  might  attain  from  either  all 
garrison  or  all  TEC  training;  and  A  and  E  are  as  explained  above. 

For  the  given  budget  constraint  consider  first  that  the  hourly 
cost  for  each  type  of  training  exists  so  that  the  expression 

B=YG+TT  +  K  +  4iF  I 

represents  the  cost  of  various  mixes  of  the  three  types  of  training 
where  Y  >  'f' >  and  (J)  are  the  hourly  costs  of  garrison,  TEC,  and  field 
training,  and  K  is  a  fixed  cost  associated  with  any  amount  of  TEC 
training  (provided  that  TEC  is  used) .  Consider  second  that  B  denotes 
a  fixed  budget  available  for  training  so  that 

b’  =  yG+TT  +  K  +  (J)F  ( 

is  the  budget  constraint  -  i.e.,  only  those  mixes  of  C,  T,  and  F  whose 
total  cost  does  not  exceed  B  are  permissible. 

Now,  there  are  four  steps  to  carry  out.  In  turn  they  determine 


o  the  maxiinum  value  of  E  attainable 
with  B  and  with  no  T.  This  value 
is  denoted  E. 

°  the  maximum  value  of  E  attainable 
with  B  and  with  T.  This  value  is 
denoted  E. 

°  the  minimum  budget  with  which  E 
can  be  achieved  with  T.  This 
budget  amount  is  denoted  B. 

°  the  minimum  budget  with  which  E 
can  be  achieved  with  no  T.  This 

A 

budget  amount  is  denoted  B. 

Note  that  this  first  is  necessary  to  perform  the  third,  and  the  second 
is  necessary  to  perform  the  fourth.  When  B  and  B  are  determined,  C(T) 
and  E(T) ,  the  compensating  budget  variation  and  the  equivalent  budget 
variation,  can  be  calculated,  since  B  is  kno\>m  a  priori.  Specifically 
C(T)  =  B  -  ^  and  E(T)  =  B  -  ¥. 

The  first  step  is  accomplished  by  solving  the  problem 
MAX  E  =  1  +  [l  -  m  (1  -  e  ^  -  m  (1  -  e  [r 

B  =  yG+  tT  +  K+  (|)F 


given 


The  relevant  Langrangian  expression  is 


L  =  1  +  |a  -  1  [^1  -  m  (1  -  Je-fpj  +  X  -  -yG  -  .  C 


First  order  conditions  are 


11=  [a  -  [l-m(l  -  e-gG^  [e-ff]  [-f]  -  X(>  =  0  (2 

=  B  -  yG  -  c;)F  =  0  (2 

Solving  (21),  (22),  and  (23)  as  a  set  of  simultaneous  equations  yields 


G  =  In 


;c^g  -  Yf)~ 
(1  -  m)  _ 


®  and 


^  6  pn  (4>g  -  Yf)~|  (25 

LYf  (1  -  m)  J 

Expressions  (24)  and  (25)  constitute  the  solution  to  (19),  and  substitut 

ing  them  into  the  effectiveness  production  function,  (16),  yields 

II  -fB 

-  t-]  i^]  t  ^]- 

Remember  that  the  regression  or  other  analysis  used  to  select  (16) 
provided  numerical  estimates  for  the  parameters  A,  g,  t,  f,  and  m; 
also  remember  that  B,  y,  T,  <{),  and  K  are  knotvn. 


Going  on  to  the  second  step,  the  problem  to  solve  is 


MAX  E  =  1  +  I^A  -  ij  |l  -  m  (1  -  e  ®^)J  j^l  -  m  (1  -  e"*^'^)  |^e 


given  B  =  yG  +  tT  +  K  +  (t)F 
G,  T,  F  >  0. 


Proceeding  similarly  as  in  the  first  step,  the  solution  to  (27)  is 


rni(({)R-Yf)~|  ^ 

G  -  In  J 

,  rm(4>t:-Tf  )1  t 
T  =  In  (1-m)  J 

rm(4)s-Yf)1 

F  =  ti)  -  LWo^J 

which  upon  substitution  into  (16)  yields 

Yf 


rni((j)t-Tf)n 
LTfd-m)  J 


4>t  , 


E  =  1  + 


r  1  rt!)g(i-m)i  rm((^g-Yf)]  ?g  r6t(i-iii)~[  rmc^t^)!  r  -f“s  1 

[A  -  ^  [(^2  -  YfJ  LYfU-™)]  bt  -  TfJ  LTfd-m)  J  Lf  J 


Step  three  involves  the  problem: 

MIN  B  =  YG  +  tT  +  K  +  <!)F 


riven  E=l  +  A-1  1-md-e  1  -  m  (1  -  e  |e' 


G,  T,  F  -  0. 

Here  the  relevant  Lagrangian  expression  is 


L  =  yC  +  tX  +  K  +  4)G  +  X 


If  _  1  -[a  -  I]  Fl  -  m  (1  - 
L  [ih  „  d^-  e-tT)]  J  . 


Here,  as  in  the  first  and  second  steps,  taking  the  partial  derivatives 
of  L  with  respect  to  G,  T,  F,  and  X  and  setting  the  partials  equal  to 
zero  gives  the  first  order  conditions 

|L  =  Y+^[A-^[l-md  -  ° 

=  T  +  X  [a  -  ll  [l  -  m  (1  -  e-gC^  |j:me"’^'^j  =  0 


Solviag  (32)  as  a  set  of  sinu Ltaneous  equations  yields 


G  =  In 


T  =  In 


rm(ct)g-Tf)1  g 

l_Yf(l-m)  J 

rin((;)t-T£)~|  t 

Uf  (1-m  )J 


F  =  ^  -  In  r^(^g-:Lf) 


and  substituting  (33)  into  (17)  givei 


B  =  B  +  K  +  In  Ti(i_m)^  -  In 


Fiizil  1 

l_ii)t(l-in)j 


As  the  last  step,  the  fourth  requires  solving  the  problem 


MIN  B  =  yG  +  tT  +  K  +  (j)? 


given  E  =  1  + 
T  =  0 

G,  F  ^  0. 


The  solution  is 


[a  -  l]  [l 


1  -  m  (1  -  e' 


^)]  1^1  -  m  (1  -  e  ^'^)J 


G  =  In 


B-K 

^  ”  4)  -  Iri 


LYf(l-m)  J 

^  _  In  MIHiYOI 

LYfd-m)  J 


1 

rm(4)t-Tf)lc!)t  +Fn  Ut-Tf  If 

ljf(i-m)J  L^txr^J 


and  therefore 


B  =  B  -  K  + 


f(!>i:-Tf  1  f  r, 

In  [_4)t(l-m)J  -  In  [j 


m((j>t-Tf)~|  t 

Tf(l-m)  J 


’55 


No\v,  using  (34)  the  compensating  budget  variation,  C(T)  =  B  -  B,  is  v 

J.  ^ 

1  N 

r4)t-Tf_“i  f  rin((j)t  -Tf)i  t  ,  , 

In  [4)t(l-md  -  In  Tf(I-n)J  -  K;  (38) 

A, 

and  using  (37)  the  equivalent  budget  variation,  E(T)  =  B  -  B  is 

rs’t-Tf  1  f  rm(0t-Tf)"[  7 

|J)t(i-m)J  ~  [rfd-cnT^J 


Two  points  relative  to  (18)  and  (39)  are  noteworthy: 


PRESEN’T  VALUE  ANALYSES 


An  important  part  of  a  TEC  CTEA  is  tlie  aggregation  of  TEC  costs 
and  benefits  over  t ime ,  step  four  of  the  methodology.  That  is,  an 
intertemporal  aggregation  methodology  must  be  a  component  of  a  TEC 
CTEti  methodology.  Intertemporal  aggregation  permits  a  series  of 
annual  costs  and  benefits  to  be  distilled  to  the  single  number  which 
is  the  sought  measure  of  the  value  of  TEC.  While  there  exist  a  large 
number  of  aggregation  schemes,  most  are  variants  of  the  following 
four  well  recognized  approaches. 

°  Payback  Period.  The  investment  is 
judged  worthwhile  if  it  generates 
enough  cost  savings  to  pay  back  the 
initial  cost  of  the  investment  within 
some  given  maximum  period  of  time, 
e .g . ,  five  years . 

°  Benefit  Cost  Ratio.  The  investment 
is  deemed  v/orthwhile  if  the  ratio  of 
the  present  value  of  benefits  to  the 
present  value  of  costs  equals  or  ex¬ 
ceeds  unity. 

°  Internal  Rate  of  Return.  The  invest¬ 
ment  is  accepted  as  v;orthwhile  if  its 
rate  of  return  t'.quals  or  exceeds  some 
predetermined  hurdle  rate. 


°  Net  Present  Value.  The  investment 
is  determined  to  be  worthwhile  if 
the  algebraic  sun  of  the  discounted 
costs  and  benefits  exceeds  zero. 

Table  1  presents  a  more  formal  com¬ 
parison  of  these  approaches. 

Interestingly,  while  each  of  these  measures  of  investment  worth 
performs  the  requisite  intertemporal  aggregation,  each  results  in 
a  single  number  of  different  dimensions,  and  a  different  accept/ 
reject  criterion.  Today,  Net  Present  Value  is  generally  regarded 
as  the  best  approach  to  intertemporal  aggregation.  This  is  because 
the  Payback  Period  approach  ignores  all  costs  and  benefits  beyond 
the  period  required  to  recover  initial  costs,  and  both  the  Benefit 
Cost  Ratio  and  the  Internal  Rate  of  Return  ignore  the  total  size  of 
the  net  benefits  in  favor  of  rate  measures,  i.e.,  dollars  of  bene¬ 
fits  per  dollar  cost  or  dollar  per  year  of  benefits  per  dollars  per 
year  of  costs. 

Our  goal  in  a  CTF.A  is  the  development  of  methodology  to  evaluate 
specific  training  concepts  or  programs.  The  central  element  in  the 
methodology  is  the  determination  of  the  value  of  the  training  program 
to  a  unit.  This  determination  is  accomplished  using  the  concepts  of 
compensating  and/or  equivalent  budget  variations.  Of  course,  the 
methodology  must  consider  all  the  elements  which  affect  the  "bottom 
line"  value  of  the  entire  program,  and  tie  all  these  considerations 


together  to  arrive  at  an  ultimate  dollar  valuation  of  the  program. 
The  relevant  elements  include 


D 

t 

M 


t 

V(T  ) 

*  It 


H 


d 

L 


NPV(T*) 


the  program  development  costs  in  year  t 
the  program  maintenance  costs  in  year  t 
the  value  of  the  program  to  unit  1  in  year  t 
the  time  horizon  for  the  program,  i.e.,  t  =  0, 
1,  2,  ....  H 
the  discount  rate 

the  number  of  groups  using  the  program,  i.e., 
1=1  ...,  L 

net  present  value  of  the  training  program 


The  value  of  the  program  can  be  determined  using  an  extension  of 

the  Net  Present  Value  expression  in  Table  1.  The  Net  Present 

VAlue  of  the  training  program  is  computed  as 

L 

Dt  +  +  I  V(T*);,t 

=  1 

(1  +  d)t 

By  conventional  standards,  a  program  is  deemed  worthwhile  if  NPV  > 0; 
and  not  worthwhile  otherwise. 


H 

NTV(T*)  =  Z 
t=0 


With  regard  to  the  variables  in  (  ) ,  we  night  expect  to  be 
high  in  the  early  years  and  taper  off  thereafter.  We  would  expect  the 
opposite  for  Mj.  and  V(T*)£(..  The  selection  of  a  discount  rate  can  be 
a  complex  issue.  However,  there  exist  military  guidelines  and  these 


should  be  considered.  Presently,  a  value  of  10’<  is  su::'ested  for  d. 


SUMMARY  AMD  FURTHER  CONSIDERATIONS 


SUMMARY 

This  is  the  second  report  dealing  with  CTEA  methodology  directed 
at  determining  the  relative  value  of  TEC  training  to  unit  combat 
effectiveness.  The  initial  document^S  reported  on  a  review  and  eval¬ 
uation  of  literature  relevant  to  a  TEC  CTEA  and  should  be  viewed  as 
an  introduction  and  background  to  this  report.  As  discussed  in  the 
preceding  report,  because  of  TEC's  unique  complementary  role,  it  does 
not  fit  the  usual  training  program  mold;  therefore,  analytical  tech¬ 
niques  available  in  current  literature  are  not  completely  suitable  for 
a  TEC  evaluation.  This  report  develops  a  TEC-specific  evaluation 
methodology  -  a  new  approach  to  training  evaluation.  The  approach 
adopted  in  the  development  of  this  CTEA  methodology  is  an  extension 
of  a  model  and  several  concepts  from  economic  theory.  The  model  used 
here  to  guide  the  choice  among  various  types  of  training  and  to  assess 
the  value  of  TEC  is  an  extension  of  the  microeconomic  theory  of  the 
consumer.  Basically,  we  substitute  a  training  effectiveness  production 
function  for  the  traditional  utility  function,  where  the  former  has 
much  the  Scime  mathematical  structure  as  the  latter.  The  key  concepts 
employed  here  in  developing  dollar  values  for  the  TEC  program  are  the 
compensatory  budget  variation  and  the  equivalent  budget  variation. 

These  concepts  are  central  to  theoretical  welfare  economics,  where 
they  provide  measures  of  the  welfare  effects  of  price  changes  on  con¬ 
sumers.  We  extend  these  concepts  to  provide  dollar  measures  of  the 
value  of  training  programs.  The  TEC  CTEA  methodology  can  be  used  to 
provide  an  objective  economic  evaluation  of  the  contribution  TEC  train¬ 
ing  makes  to  unit  performance.  The  methodology  involves  four  steps: 

o  Specification  and  estimation  of  an  Effectiveness 
Production  Function. 

o  Estimation  of  the  "per  unit"  costs  of  the  different 

types  of  training  contributing  to  overall  effectiveness, 
as  well  as  determination  of  the  magnitude  of  the  train¬ 
ing  budget. 

o  Calculation  of  the  current  value  of  the  TEC  Program. 

o  Calculation  of  the  present  value  of  the  TEC  Program. 
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Each  of  these  steps  involves  a  number  of  substeps.  The  four  steps  are 
discussed  in  the  second  section. 


FURTHER  CONSIDERATIONS 

This  report  presented  a  new  approach  to  training  evaluation;  however, 
at  this  point,  it  is  appropriate  to  point  out  some  problems  which  remain 
to  be  solved  before  the  methodology  can  be  called  complete,  and  before 
it  can  be  implemented  in  a  step-by-step,  if  not  mechanical,  fashion.  Un¬ 
fortunately,  the  remaining  problems  are  essentially  empirical,  and  can  be 
resolved  only  by  collecting  and  experimenting  with  actual  data.  These  are 
three  related  areas  of  concern. 

o  Units  of  Observation. 

The  methodology  is  compatible  with  units  of  any  size, 
from  individuals,  squads,  and  platoons  to  entire 
battalions.  However,  different  choices  imply  different 
data  requirements,  different  data  availability  and 
quality,  and  different  aggregation  schemes.  In  the 
same  vein,  the  methodology  is  compatible  with  units 
of  different  types,  e.g.  rifle  squads,  tank  crews, 
artillery  sections,  etc.,  where  the  observational 
units  might  be  grouped  accordingly.  The  time  period 
covered  by  a  single  observation  is  also  open  to  choice. 
Observations  might  refer  to  a  month,  3  months,  year, 
etc.  In  all  these  choices,  theory  is  of  little  value 
as  a  guide.  Quite  sinply,  the  question  is  which 
approach  works  best. 

o  Inference. 

Very  likely  it  will  be  neither  possible  nor  desirable 
to  gather  data  on  all  instances  of  TEC  usage.  It 
follows  that  the  required  estimate  must  be  constructed 
using  some  type  of  inferential  procedure. 


o  Size  of  the  Data  Set. 


The  number  of  variables,  and  the  number  of  observa¬ 
tions  of  each  variable  depend  on,  inter  alii,  the 
variances  and  invariances  in  the  data.  Clearly, 
only  experience  with  actual  data  will  reveal  these 
statistics . 

The  importance  of  the  foregoing  issues  should  not  be  minimized. 
While  none  of  the  problems  are  insurmountable,  their  substantial 
resolution  is  a  prerequisite  to  a  complete  CTEA  methodology.  And  as 
already  stressed,  their  resolution  depends  on  the  collection  of  and 
experimentation  with  actual  data. 
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